The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin (...) by introducing the concept of Type I error rates and distinguishing between statistical errors and theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers’ misinterpretation of statistical errors and their underestimation of theoretical errors. (shrink)

During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference about a joint union alternative hypothesis (e.g., “H1,1 or H1,2”). However, in some cases, they do not make this inference. Instead, they make separate inferences about each of the individual hypotheses that comprise the joint hypothesis (e.g., H1,1 and H1,2). For example, a researcher might use a Bonferroni correction to adjust their alpha level from the conventional level of 0.050 to 0.025 (...) when testing H1,1 and H1,2, find a significant result for H1,1 (p < 0.025) and not for H1,2 (p > .0.025), and so claim support for H1,1 and not for H1,2. However, these separate individual inferences do not require an alpha adjustment. Only a statistical inference about the union alternative hypothesis “H1,1 or H1,2” requires an alpha adjustment because it is based on “at least one” significant result among the two tests, and so it refers to the familywise error rate. Hence, an inconsistent correction occurs when a researcher corrects their alpha level during multiple testing but does not make an inference about a union alternative hypothesis. In the present article, I discuss this inconsistent correction problem, including its reduction in statistical power for tests of individual hypotheses and its potential causes vis-à-vis error rate confusions and the alpha adjustment ritual. I also provide three illustrations of inconsistent corrections from recent psychology studies. I conclude that inconsistent corrections represent a symptom of statisticism, and I call for a more nuanced inference-based approach to multiple testing corrections. (shrink)

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self-criticism; (2) a fast ‘n’ bropen (...) scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience. (shrink)

Niels Bohr was born on October 7, 1885. He was one of the great innovators in physical science in the twentieth century. It so happens that 1985 also marks fifty years since the long discussions, which had begun in the 1920s between Albert Einstein and Bohr on the philosophical problems of quantum physics, attained their apogee. An article co-authored by Einstein, B. Podolsky, and N. Rosen, "Can Quantum Mechanics Be Considered a Complete Description of Physical Reality?," was published in 1935 (...) in the journal Physical Review. According to Bohr, "by virtue of its clarity and, it would seem, flawless argumentation, the work of Einstein, Podolsky, and Rosen has created excitement among physicists and played a great role in the discussion of general philosophical questions of physics." Precisely as a result of the publication of this article, the critical position of Einstein concerning quantum mechanics became known to a broader circle of physicists. In the same year, Bohr responded to Einstein and his co-authors with an article under the same title. (shrink)

The discovery of the microworld presented a serious trial for many systems of views held by mankind, including its logic. This world was found to lack the familiar solid bodies, the unchanging particles and interrelations between them, the reflection of which, in one way or another, is the logic of the macroscopic world. What elementary particle physics encountered in the microscopic world seemed illogical: the rest-mass of a particle equals zero; a part that is not smaller than the whole; a (...) particle that in diffraction experiments moved like a wave; and much else that was unusual and strange in the properties of elementary particles. One of these properties was actually so named by physicists — "strangeness.". (shrink)

The problem of the relationship between mathematics and objective reality, which arose in early antiquity, is still a subject of heated discussion. The discussions are mainly about the question that probably was posed most clearly by Immanuel Kant in his Critique of Pure Reason: "How do subjective conditions of thought have objective validity, that is, how do they become conditions of the possibility of all knowledge of objects?" Is it because they are themselves elements of objective reality, or because they (...) are contained in thought a priori, before and independently of experience, or, finally, because they are subjective images of corresponding facets and aspects of objective reality? (shrink)

Several researchers have recently argued that p values lose their meaning in exploratory analyses due to an unknown inflation of the alpha level (e.g., Nosek & Lakens, 2014; Wagenmakers, 2016). For this argument to be tenable, the familywise error rate must be defined in relation to the number of hypotheses that are tested in the same study or article. Under this conceptualization, the familywise error rate is usually unknowable in exploratory analyses because it is usually unclear how many hypotheses have (...) been tested on a spontaneous basis and then omitted from the final research report. In the present article, I argue that it is inappropriate to conceptualize the familywise error rate in relation to the number of hypotheses that are tested. Instead, it is more appropriate to conceptualize familywise error in relation to the number of different tests that are conducted on the same null hypothesis in the same study. Under this conceptualization, alpha level adjustments in exploratory analyses are (a) less necessary and (b) objectively verifiable. As a result, p values do not lose their meaning in exploratory analyses. (shrink)

Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove hypotheses on the basis of those results without acknowledging this process in their research report (Kerr, 1998). In the present article, I discuss three forms of HARKing: (1) using current results to construct post hoc hypotheses that are then reported as if they were a priori hypotheses; (2) retrieving hypotheses from a post hoc literature search and reporting them as a (...) priori hypotheses; and (3) failing to report a priori hypotheses that are unsupported by the current results. These three types of HARKing are often characterized as being bad for science and a potential cause of the current replication crisis. In the present article, I use insights from the philosophy of science to present a more nuanced view. Specifically, I identify the conditions under which each of these three types of HARKing is most and least likely to be bad for science. I conclude with a brief discussion about the ethics of each type of HARKing. (shrink)

RESUMENEl concepto de acontecimiento tiene en la obra de Žižek una función predominantemente política, pese a que su realización es deudora de la ontología que el esloveno desarrolla. Una de sus finalidades fundamentales será dilucidar si se puede distinguir entre un acontecimiento y un acto. En caso afirmativo, este último pasaría aconsiderarse com o el modo mediante el cual una subjetividad se relaciona con el acontecimiento. El objetivo que persigue el pensador esloveno es ayudar con esta concepción al desarrollo de (...) una alternativa al capitalismo.PALABRAS CLAVEACTO, ACONTECIMIENTO, CAPITALISMO, FANTASMAABSTRACTThe concept of event has an ultimately political role in Žižek’s work despite its realization is indebted to the development of Žižek’s ontology. One of his main purposes will be to clarify whether it’s possible to differentiate event from act. If so, actwould become the means by which subjectivity relates to event. Žižek’s target is to use this concept to help develop an alternative to capitalism.KEYWORDSACT, EVENT, CAPITALISM, GHOST. (shrink)

"Dr. Rubin has brought cognitive psychology into a wholly unprecedented dialogue with studies in oral tradition. The result is a truly new perspective on memory and the processes of oral tradition." --John Miles Foley, University of Missouri.

Gelman and Loken (2013, 2014) proposed that when researchers base their statistical analyses on the idiosyncratic characteristics of a specific sample (e.g., a nonlinear transformation of a variable because it is skewed), they open up alternative analysis paths in potential replications of their study that are based on different samples (i.e., no transformation of the variable because it is not skewed). These alternative analysis paths count as additional (multiple) tests and, consequently, they increase the probability of making a Type I (...) error during hypothesis testing. The present article considers this forking paths problem and evaluates four potential solutions that might be used in psychology and other fields: (a) adjusting the prespecified alpha level, (b) preregistration, (c) sensitivity analyses, and (d) abandoning the Neyman-Pearson approach. It is concluded that although preregistration and sensitivity analyses are effective solutions to p-hacking, they are ineffective against result-neutral forking paths, such as those caused by transforming data. Conversely, although adjusting the alpha level cannot address p-hacking, it can be effective for result-neutral forking paths. Finally, abandoning the Neyman-Pearson approach represents a further solution to the forking paths problem. (shrink)

The National Center for Biomedical Ontology is a consortium that comprises leading informaticians, biologists, clinicians, and ontologists, funded by the National Institutes of Health (NIH) Roadmap, to develop innovative technology and methods that allow scientists to record, manage, and disseminate biomedical information and knowledge in machine-processable form. The goals of the Center are (1) to help unify the divergent and isolated efforts in ontology development by promoting high quality open-source, standards-based tools to create, manage, and use ontologies, (2) to create (...) new software tools so that scientists can use ontologies to annotate and analyze biomedical data, (3) to provide a national resource for the ongoing evaluation, integration, and evolution of biomedical ontologies and associated tools and theories in the context of driving biomedical projects (DBPs), and (4) to disseminate the tools and resources of the Center and to identify, evaluate, and communicate best practices of ontology development to the biomedical community. Through the research activities within the Center, collaborations with the DBPs, and interactions with the biomedical community, our goal is to help scientists to work more effectively in the e-science paradigm, enhancing experiment design, experiment execution, data analysis, information synthesis, hypothesis generation and testing, and understand human disease. (shrink)

A tese defende o antiplatonismo presente na obra do jusfilósofo Hans Kelsen como núcleo argumentativo da sua teoria do direito. Sustenta que a melhor definição da sua filosofia não é como neokantiana, mas como antiplatônica. Isso porque há significativas inconsistências na sua interpretação de Kant, o que a impossibilita de ser classificada como tal. Além, encontra-se na sua leitura sobre Platão referências mais sólidas e conceitos mais claros. Nesse sentido, advoga a hipótese de que a obra de Kelsen tem como (...) constante e como chave de entendimento a sua objeção e contestação às teses de Platão, sobretudo a questão da separação entre alma e corpo, isto é, forma e matéria. O primeiro e segundo capítulos defendem a hipótese da inconsistência das teses de Kelsen sobre Kant. Entende que a sua pressuposição de contradição entre a razão pura e a razão prática, assim como a ideia de uma contradição entre ser e dever-ser, não se sustenta considerando as próprias obras de Kant e a literatura especializada sobre o autor. No segundo capítulo apresenta a sua leitura sobre Platão, concentrada na obra A Ilusão da justiça (Dei Illusion der Gerechtigkeit). O quarto capítulo expõe, sopesando seu antiplatonismo, as duas principais referências teóricas para Kelsen a par de Kant, isto é, as teorias de David Hume e Sigmund Freud. O quinto capítulo demonstra como o antiplatonismo de Kelsen articula com os principais conceitos de suas teses, isto é, mostra que mesmo refutando a classificação do autor como neokantiano, conceitos como norma fundamental, liberdade, o monismo entre direito e Estado, monismo entre direito internacional e nacional e o problema da decisão judicial possuem justificativa e base filosófica coerente. Finalmente, conclui com a possiblidade da ideia de uma teoria kelseniana do direito desvinculada do neokantismo e fundada sobre os pressupostos céticos humeanos e freudianos, tanto moral, quanto teórico, ou seja, reconhece a unidade das obras do autor, desde que condicionada a sua interpretação como antiplatônica. (shrink)

To provide the three-way comparisons needed to test existing theories, we compared (1) most-stressful memories to other memories and (2) involuntary to voluntary memories (3) in 75 community dwelling adults with and 42 without a current diagnosis of posttraumatic stress disorder (PTSD). Each rated their three most-stressful, three most-positive, seven most-important and 15 word-cued autobiographical memories, and completed tests of personality and mood. Involuntary memories were then recorded and rated as they occurred for 2 weeks. Standard mechanisms of cognition and (...) affect applied to extreme events accounted for the properties of stressful memories. Involuntary memories had greater emotional intensity than voluntary memories, but were not more frequently related to traumatic events. The emotional intensity, rehearsal, and centrality to the life story of both voluntary and involuntary memories, rather than incoherence of voluntary traumatic memories and enhanced availability of involuntary traumatic memories, were the properties of autobiographical memories associated with PTSD. (shrink)

Clinical psychologists' and nonpsychiatric physicians' attitudes and behaviors in sexual and confidentiality boundary violations were examined. The 171 participants' responses were analyzed by profession, sex, and status (student, resident, professional) on semantic differential, boundary violation vignettes, and a version of Pope, Tabachnick, and Keith-Spiegel's (1987) ethical scale. Psychologists rated sexual boundary violation as more unethical than did physicians (p<.001). Rationale (p<.01) and timing (p<.001) influenced ratings. Psychologists reported fewer sexualized behaviors than physicians (p<05). Professional experience (p<.01) and sex (p<.05) were (...) associated with confidence-violating behavior. Overall, 78% of the sample reported attitudes or behaviors associated with boundary violations. The behavior violations were correlated (r=.49). Actual violators rated vignette violators more leniently than did nonviolators (p<.01). (shrink)

A model for measurement in collapse-free nonrelativistic fermionic quantum field theory is presented. In addition to local propagation and effectively-local interactions, the model incorporates explicit representations of localized observers, thus extending an earlier model of entanglement generation in Everett quantum field theory (Rubin in Found. Phys. 32:1495–1523, 2002). Transformations of the field operators from the Heisenberg picture to the Deutsch-Hayden picture, involving fictitious auxiliary fields, establish the locality of the model. The model is applied to manifestly-local calculations of the (...) results of measurements, using a type of sudden approximation and in the limit of massive systems in narrow-wavepacket states. Detection of the presence of a spin-1/2 system in a given spin state by a freely-moving two-state observer illustrates the features of the model and the nonperturbative computational methodology. With the help of perturbation theory the model is applied to a calculation of the quintessential “nonlocal” quantum phenomenon, spin correlations in the Einstein-Podolsky-Rosen-Bohm experiment. (shrink)